Learning Sounding gestures

نویسندگان

  • Amalia de Götzen
  • Luca Mion
  • Federico Avanzini
  • Stefania Serafin
چکیده

Non-visual senses can be used in toys to enhance and enrich the play experience. Previous research has shown that – especially for young children developing sensory-motor skills – exploration and play are two tightly linked activities: everything is new and needs to be “studied”, and playful behaviors emerge from active exploration. The main idea of this paper is to provide a new approach in designing and realizing objects that elicit this type of behavior and encourage exploration by providing dynamic, real-time haptic, tactile, auditory feedback depending on a child’s gestures, movements, and emitted sounds. These toys provide interaction based on the enactive para–digm, where multimodal feedback is intimately tied to action – i.e. the human is “in the loop”. Moreover, these musical toys will teach how to perform musical gestures.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Sonic Gestures and Rhythmic Interaction between the Human and the Computer

Aalto University, P.O. Box 11000, FI-00076 Aalto www.aalto.fi Author Antti Jylhä Name of the doctoral dissertation Sonic Gestures and Rhythmic Interaction between the Human and the Computer Publisher School of Electrical Engineering Unit Department of Signal Processing and Acoustics Series Aalto University publication series DOCTORAL DISSERTATIONS 32/2012 Field of research Acoustics and audio s...

متن کامل

Hybrid Motion Control combining Inverse Kinematics and Inverse Dynamics Controllers for Simulating Percussion Gestures

Virtual characters playing virtual musical instruments in a realistic way need to interact in real-time with the simulated sounding environment. Dynamic simulation is a promising approach to finely represent and modulate this interaction. Moreover, capturing human motion provides a database covering a large variety of gestures with different levels of expressivity. We propose in this paper a ne...

متن کامل

The Flo)(ps: Negotiating Between Habitual and Explorative Gestures

The perceived affordances of an everyday object guide its user toward habitual movements and experiences. Physical actions that are not immediately associated with established body techniques often remain neglected. Can sound activate those potentials for action that remain latent in the physicality of an object? How can the exploration of underused and unusual bodily movements be fostered? Thi...

متن کامل

Real-Time Simulation and Interaction of Percussion Gestures with Sound Synthesis

Virtual characters playing virtual musical instruments must interact in real-time with the sounding environment. Dynamic simulation is a promising approach to finely represent and modulate this interaction. Moreover, captured human motion can provide a database covering a large variety of gestures with various levels of expressivity. We propose in this paper a physics-based environment in which...

متن کامل

A method for measuring the intelligibility and nonnativeness of phone quality in foreign language pronunciation training

The problem addressed is automatically detecting, measuring and correcting nonnative pronunciation characteristics (so-called "for-eign accents") in foreign language speech. Systemic, structural and realizational differences between L1 (native language) and L2 (target language) appear as phone insertions, deletions and substitutions. A bilingual phone recognizer using native-trained acoustic mo...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2007